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Purpose 



In response to the request from the Interagency Panel on Early Child- 
hood Research and Development , a series of interviews were scheduled to " '.\ 
elicit information on the process by which participating agencies establish 
research priorities, translate these priorities into research activities, 
and how thejresearch finding's are utilized in further policy, d£ci$ions and 
research planning. V c , t I s -" 



Method 



Interviews with key staff w6re arranged and conducted in person or by 
telephone. The interview guide used is in Appendix A. In addition/ printed 
brochures and written documents provided by the staff of the agencies were 
utilized to augment the interview information. The information obtained by 
these two methods has been compiled and analyzed. Reported here is a 
synthesis c(f these data. 

"V TV- .. ' ' — - 



Overview 

Analysis of the data indicates that the Research and Development (R & D) 
process is^divided into four interrelated phases: 

1. 1 T^e planning phase, which begins with 

.' s • ■ \ ■ ' r . ... ... • 

\ - the legislative authorization, 

l s ' c - . 

- the official agency objectives, 



See Glossary for definition of the term "Agency" as used in this paper 
(pp. 25-26). , ■ 



- the communication system of the -agency, ; 

- the process of establishing long and short 

term priorities, 

• , ' - - ■ ' ' ti . - x . - ' ■ ■ ' 

- the scope of funding of the particular 

I ■ \ : * ' ' '.. ^ : ' 

agency, ;■/>.. 
\ - and the allocation of funds among priorities, 
The funding phase which includes 

} - the^ methods by which research proposals 

are obtained, 

- the methods by which proposals are funded, 

> . • ■ 

including 

- the predominant funding mech- 
anisms utilized by the agency, 

- and the review system of the 

..... v. ' , . . 

agency. 

The research implementation phase includes , 

- the implementation of the research activity, 

- and the monitoring of the activity. 

The reporting,, dissemination and feedback stage includes } 

- method^ of reporting to the funding agency, 

- method of disseminating information by the 
researcher to the R&D community and pro- 
grams , operation^, e 

- and utilization of findings by the agency 

and the R&D community in further priority ' 
; ■ setting. 



Iii prder to understand, the various formal and informal means of 

establishing R&D priorities, translating these priorities into agency. 

research activities, and utilizing findings in feedback for further pri- 

. / • " .'• 

ority setting, it is necessary to describe each stage of the planning, 

funding, implementation and feedback cycle of the funding ^gency. This 

cycle varies widely among the agencies, and these variations as well as 

the common elements in the cycle are discussed below. The common elements 

are presented i^i Chart I on page 4 . The process by which research activities 

are planned, developed, and findings utilized is affected at e$ch stage by 

numerous factors within the agency referred to as "internal 11 influences. 

In addition, many external factors affect and are affected by the R&D 

cycle at all four* stages as shown on Chart I. ( 

■ i 

The Planning Phase 

All agencies report having "official 11 objectives which regulate research 
priorities relating to young children* These objectives stem from legisla-. 
tive mandates as well as long term policy decisions. The objectives vary 
with the area of concern of the agency: education, mental hea.lth, child 
health and human development, etc. They also vary in terms of the target 
population: retarded, low-income, maternal and infant care , handicapped chil- 
dren, etc. In addition, objectives vary with the research emphasis of the 
agency: basic, applied, evaluative, etc* In several cases, the type of 
research funded is regulated by legislative mandate. For a description of 
"official 11 objectives see the paper: "Broad Agency Goals and Agency Research 



•••V/ I 



Objectives for FY 1 72 • <r ' 

: : ■, . ... ... ■■ ' - ■ • .. ■ \ •< .a- , r ' . ■ . , 

Most agencies report that they have written five year plans describing 

- . . . • f 1 """ — * - , ■ . ■■' « 

.their research priorities. These five year plan^ are revised and updated 

• • \ '• / • • ~" ' ... *• % • . , ; ' i .. • ;■ . ' . • : 

^ each fiscal year. Revisions are made^on the basis of mahy* external factors 
including: new research findings, changes in Congressional and Executive 
emphases, arid high level task forces such as the White House Conference on y 
Children and Youth, ^Examples jbf revisions of existing' five year plans made 



recently are the emphasis on day care research resulting from social trends 
as well as Congressional interest, and the emphasis on advocaby, resulting 

. - :. '.■ - 1 vr . , 

primarily from the White House Conference. Social trends such as a rising 4 

nemployment rate or new interest i n 'welfare reform also were reported to ; 
.influence short term priority setting. The total aiuuurit of- funding and * 
the amount of new funding are reflected in priorities, \ 

Agencies vary ift the ways that they m^e information jabout long and 
stjqrt term priorities available- to early childhood research and development 
staff of their own agenoie*. Written five year plans a*re generally made 
available to department chiefs. However, most' information about change? in 
research priorities or new research priorities are communicated through 
Q^Q 'conferences and stpff meetings. Described as the "f ilteratipn" system, 
vt**j staff meetings are held at various levels starting with the agency director, 
((Ns* department chief, and then other key st,aff, and priorities are described and 
CnJS^ discussed. One agency ^^^rted^that Executive directives were, a major 
o source of information regulating staff priorities. 

{jf$ ' Selection of dtte year priorities are influenced by various internal a 
£8*0 factors including the structure of the staff, its pattern of communication 
and group .dynamics, as we\X as by the particular interests' of key staff 



1* 



members , and the director. Five different methods of establishing annual 

research priorities were described* these five methods vary* as to fehe 

- . ■ ' . ' ■ *'. * 

amount of input from the agency director, from the R&D staff of the . 

a '***••■ »*» ■ ■ ■* '/••.■■ , ♦. * ■ 

agency, from agency program^staf f , and from external sources, including 

teld staff and professionals in the R&D community* the five processes 
repotted for establishing R&D priorities are: ' 
1. Key R & D staff spend a period of time conferring with program staff 

on present status and future needs of the agency. Department chiefs 

■* ■ . . 

then meet individually with the Agency directdr to report on .recent 

/ ■• • * ' ■ 

findings, gaps and needs in their research areas. Written estimates 
of the amount of funding necessary to fulfill needs are usually sub- 
mitted at this time, the director meets in turn with each department 



head and v draws up a set^of overall" priorities for the agency an<J allo- 
cates fund^ among' the priorities . 

This method allows for R & D.staff input while still vesting 
decision-making power in the director. While the decision of . 
»' the director is not affected by dynamics of a group, it is subject 
to the possibility that some persuasive department chiefs may 
make a more impressive case for their department needs than less 
persuasive staff. 

5. Key R&D staff meet as a group with the director; each chief reports 
on department needs for the coming year, and the group reaches a con- 
sensus on priorities and a tentative allocation of funds among these 
priorities. 

This method allows for maximum communication and understanding 

of research status and needs between departments within the agency 

It is subject to influences of group dynamics. / 



Key R & D staff toge therewith program staf ^^ncf Associate Regional 
Directors meet as a group with the director, 4 iscilss agency objectives, 
current R & D status,)' and try- to identify gaps. Recommendations for 
future research priorities 'are made dn tl^| basis of group consensus. 
This method allows for input between program staff on both the \ 
\ federal and regional level, and maximum ^ri^nmication between* 
departments within the agency. Decisioi/s are^subject to* grpup 
dynamics as well as to social pressures (sometimes transient) from 
■ the field. 

Key R & D staff meet with prbgram people in the f £eld as well as with 

.. ■ . - ■ <> • \ , ... 

consultants. A task force wit^ numen>us subcommittees (is formed. 

Each subcommittee makes sf report on the priorities for its area. The 

recommended package of priorities is reviewed by the, agency ' director i 

and may be revised or/ reordered . ' 

This method allows for considerable input from both staff and the 

professional community while still thaintaining considerable control 

over priorities in the office of the director. 

In the final method reported, recommendations for priorities are made 

by a professional advisory council for the institute as a whole at a 

meeting attended by the institute director. 

Together with the method by which tliese agencies review and fund 

research proposals^ this method allows for. a maximum input by top 

/level professionals from the R&D community. As will be discussed 

/• 

/ later, staff make their inputs in .a later stage of the R ^ D Oycle, 

/ • ■ ' " ' / • ' 

which then affects how. priorities are implemented. // 
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In addition to the process by which annual, priorities ate established, 



priorikr setting is affected by a variety of other influences from inside 
the federal government ,6r inside the agency. Most agencies reported that 
they had changed priorities, or shifted emphases among their priorities , 
in the last year in response to directives from pASPE, from their qwu ? 
planning units; or from the institute director. v . . 

Annual priorities are also influenced by the amount of fundtfftg available. 
Staff interviewed reported that ^t various times in the past when they had 
sufficient allocations of\funds to award grants to all or almost all of ap- 
proved proposals , their priorities were more broadly defined and encoir pas seel ; 
the whole range of agency objectives. On the other hand /when agency funds 
are more limited and the agency can fund only a small proportion of its i 

v A : . ; ; v . k ■/ ■ . "-v.-. ■ i, j. , 

approved proposals, priorities are necessarily more narrowly defined. 

Agegcies also varied in the percentage of, unallocated funds they re- 
serve for funding of unsolicited proposal^ described as "creative, innovative/ 
.or brilliant." Three agencies reported that they reserved about 10% of 
£nmial funding for such potential "break-through 11 proposals but expressed 
the wish that they could reserve a larger percentage of funds from the pri- ' 
ority allocation system. 

Priority setting within agencies also varies with the scope of funding. 



The various* agencies have different proportions of their annual finding 
allocatedjto support of projects, programs, and centers. Agencies which 
have a major portion of their funding at the projec t level are most subject 



See Glossary for definition of these terms as used in this paper 
(pp. 25-26)". 



to annual shifts in priorities. This may be true whether the agency 
establishes priorities through one of thj staff d^cision-makinjg pro- 
cesses or through an external advisory bqard . Agencies which have a 
large proportion of their funds at the program level have made a longer 



\ range 1 commitment to special research afcea(3. Within these broad program 
V areas, priorities may still be reordered on the bksis of new findings 
or new agency directions. Agencies which have a large proportion of their 
funding at the center level have made lar&e scale, long term commitments * 
••-••.tp<- investigating 'major research questions, and ate least subject to annual 
f shifts in priority setting. That is ftot to say that agencies funding 
centers cannot reorder priorities, but such-shifts are generally within 
broad priori t y areas , since centers are funded to research specific 
questions such as mental retardation, ^metabolic research, vocational 
education, etc. 

* • 

■ r.. \ * * 

\ * . The Funding Phase 

As the R & D cycle moves from the planning to the funding phase , the 
degree of influence that staff exert on tjae research activity of the agency^ 
differs among the various ^encies. These dif ferences are related to the * 
manner . in which proposals are obtained, the major Emphases of research 
sponsored by' the agency: basic, applied' or evaluative, the e funding mech- 
anisms utilized bV the agency,. -and the^ review system 'of t^e agency* 

The manner in which an^afency receives proposals ih related to the* 

- traditional funding pattern of the agency as well as to the type of re- 

\ * v. t 

searfch sponsored, and to the ways in which information about priority is 

\ T • ' \ * r ' 

v dissem'^ated. Agencies which have funded basic research for many years 
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report th^t most of the proposals they receive are unsolicited . Agencies 
which make a large. proportion of their research grants to targeted areas 
generally know about, and may give consultation to R&D proposal developers* 
The number of proposals, aCd possibly the quality of proposals received by 
an ^gency, is partially related to how widely information about agency^pri- 
orities is disseminated. Several agencies reported that annual priority 
lists were circulated in-house, but not outside of the agency. At the other 
extreme, one agency reported that the annual priority list is circulated 
throughout government, mailed to previous grantees, and even published in ; ^ 
professional journals. 

Staff can influence research. proposals in a number of other ways. 
Most agencies report that their R&D staff go to professional meetings 
and discuss agency needs with potential applicants from the R & D community. 
Several agencies report that agency staff visit current and potential re- 
searchers at, universities or other research centers to discuss research 
'tweeds ? and encourage/'submission of proposals in gap areas. These agencies 
also report that they provide extensive consultation to applicants in de- 
velopment of proposals prior to and after submission. Other agencies report 
that they hold special tppic workshops for interested, competent professional 
to feed back information about current findings in specified areas and to 
stimulate further research proposals in these ideriti*f iet) areas. These are 
some of the informal ways reported by which agency staff could exert influ- 
ence on the type of research proposal Submitted as an "unsolicited proposal." 

When an agency devotes a large percentage of its research budget to 
the mechanisms of targeted grants special grants, and contracts, greater 
staff influence is exerted on the research activity of the agency* Nearly 



11 

...... i 

all agencies reported that they utilize these mechanisms at certain times. 
In these cases proposals or bids are submitted in areas of research defined 
by the agency. In the case of special grants, agency staff may collabo- 
rate on the development of the proposal and the Implementation of the ^ 
project. In the case of contracts, specifications are written by staff, and 
contracts awarded to carry out those specifications. The funding mechanism 
utilized by the agency is related to overall agency objectives and philosophy. 
Agencies which see themselves as a vehicle for support of highly competent 
professionals in the R&D community make a large proportion of theii\ grants 
through the "unsolicited proposal 11 mechanisnu Thos^ agencies which have 
clearly defined agency objectives, and sde the R&D community as a mech- ■<> 
anism by which the agency can achieve its research: * v jective£ are - more apt 
to utilize the targeted grant, special grant and contract mechanism. 

In the initial part of the funding Cycle, tfhe major external influence. 

on the R&D activities of the agencies is the interest of the R&D con^ 
munity in agency objectives which affects the nutnber , quality and variety of 

proposals that are submitted. \ ( / * , 

. ' • .'■)// ' 

Later in the funding cycle, the sele£tion/of research to be funded, 

the amount of direction and Control by the 'agency on this selection depends 

in large part on the review system of the agency \ 

As reported by the key staff interviewed, the agencies engaged in re- 

■ ' ' h ' ■ ' ' 

search and development in early childhood research utilize one of four types 

of review systems: • • | 

[ . • 

Staff Review In thij method proposals? aro reviewed and voted on 

by staff committees . Softie agencies report that they 

have standing staff committees to review proposals 

in specific areas. All who use tVi is method reported 
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cpm- 



v , that: at times they developed ad hoc staff 

mlttees to review proposals. Some agencies 
augment these staff committees by appointmLnt of 
; professionals from other agencies or outside 

' professionals. > 

Mail Review In this system, proposals are mailed td prbfes-, 

sionals who have expertise in the research area 

a • . \ . - ." . * • - A ■ ■ *s 

covered by. the proposal. Written reviews of the 

proposals are returned to the agency, and thfc 

* ? staff utilize the recommendations in finding re- 

v ■' * - ; T 

^ search proposals. \ 
Single Panel Review tn this system, proposals are reviewed by; $ com- . 

mitteo/oi professionals from outside of the agency. 
These committees may be appointed for a specified 
■ term of office, or may be appointed on ai> ad hoc 

I basis . . 

■ ' . ■ ■ - ■■ \ ... 

Dual Panel Review In this system, proposals are reviewed by a two 

•• ■ _ , r \ ■ 

tiered system of professionals from outside of the 

agency. Members of 'the first panel, referred to 

in some agencies as the "study section," are nominated 

by the agency. Except in cases of interdisciplinary 



\ research, study section members have professional 



expertise in the research area of the agency. Study 
section members review all proposals submitted to 
them, and vote to approve, defer, or disapprove the 
proposals \ Those approved are rated independently by 



members of the study section and the ratings 
averaged. All approved proposals are transmitted 
,/ to the second panel by an agency staff member 

> called the Executive Secretary. The second panel 

v. v of distinguished scientists reviews packages of 

-1 proposals from the entire organization and takes 
'action on all proposals. 
.These different review systems reflect different agency philosophies 
and purposes and allow staff to have different amounts of influence on the 
total research activity of the agency. Greatest agency influence on agency 
j^esearcl) is maintained when proposals are reviewed and funded by the s^aff 
Itself. Considerable agency direction is exerted when a mail review^is 
used and final project selection is made by-staff. Least control of agency// 
research is maintained when single or dtial panels of outside professionals/ 
decide on the agency f s research. ^ ; 7 

; - ^'X 4 • f ' :>;:: 

Hovf|ver, staff of agencies using the single* and dual panel review systems 

' •• •• * . ' j . . .\,:"V . .'• 

of outside professionals report that there are subtle and informal ways /in 

which staff can influence the research activity of the agency. As discussed 

previously, agency staff can utilize a variety of methods to stimulate "un v 

solicited proposals. 11 Staff also provide consultation in developing proposals 

fot submission in areas of particular interes^ to the agency. If a proposal 

is rejected or given a low rank by the first panel or study section and the 

agency is very inte*e$ ted 4^n the research area, ^ 

by the second panel, and assist the principal investigator in rewriting the 
proposal: for resubmission at a late* date. Finally, stiff can have an in flu- 
ehce on the direction of agency -research through nomination of outside pro- 
fessionals td the first panel or study> section. Careful selection and 

It- ■ ' 



nomination of committee members with professional Interest in areas of 
major concern to the agency can increase the likelihood that proposals 
in the area of agency concern will be approved* ' I 

After research has f>een selected for funding through the particular 
review system utilized by the agency, staff can again influence the total 

package of R & D activity^funded by the agency by negotiating the amount 

. - •»!.'. . ^ r :. ' : : • :.-"\ ' ;. . 

of funding on some or all approved grants. If ^taff^can persuade the 

* - ]> . ' ..;'/•" \; ■ / ■ ; V ' v ' v ' : /./:' 

r principal investigators to reduce proposed costs by 1^%, for example; then 

the agency can fund additional research proposals. Since most agencies 

report that ^nor^pr^oposals are approved than they have funds to support, 

4 by caref^ negotiation^ staff can increase the number of funded pft>p£sals 

and even broaden ttie range of priorities addressed. : , - 



The Implementation Phase' .« 

As the R&D activity of .federal agencies moves into the third phases, 
ImplementationSf research, the degree of»influence agencies exetft ^ranges . 
from little other than fiscal monitoring to nearly complete control. Again; ; 

-■'■\^; : ;\ : | ' ' ' ; - - - y l i "Nvi > ; . ' ' P > 

influence is highest in research implementation' in agencies whiefr^jge a high; • 



proportion of their research Eyndis for special grants, collabor-ative^studiies , 
and contracts* In such research active stafT^jliitain a mpnitoring t 

~ function,, sometimes orj almost a daily basis • ^ Staff repor^teast influence , • j 
in the 'impiefitentati^^ individual 
projects , an^A pifc'ticylarly when basic ^ res.e^rch is funded on a •lo^.jte.tfm^asis . 

. / Ex t er na 1 ^tSfc^j^n tes report ed in the imp l'ferie n t a t i on § ta$^ o f r e s ^ a rch ;>v 
activity itfcludej^ 



opmehts of Which the researcher b^^mes aware and which alter or change the \[ 
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course; of the research. In addition," changes in either research conditions 
ot general social conditions may have impact on how research grants are '1 
implemented. W 



"The relationships between various aspects of the research and demon- 



stration activities of the federal agencies interviewed and the degree of 

. . >^:v? ".^ '■■r:i' : - - ■ r Z..^^ : 

^external arid internal influence on these research activities is shown on 
Chart II on page 16. It should be noted that no agency interviewed was 
entirely within one category. However, the chart does illustrate some 
major differences among agencies which. influence priority setting, research 
funding and implementation as well as the utilization of research findings 
in f further program planning; .•?•;••.• - X* , 



The Reporting, DisseminatiO 



n and Feedback Phase 



After research is completed and reports written, the flow of infor- 
mat Ion and influence changes direction. Nov 'it is the researcher who exerts 
influence both back into the funding agency arid out into the R & D community. 

Every agency stated- tnat they required and received interim and final 
reports frpm their researchers, but the information included in these reports 
and th4 way in wjiich the agencies deal with this information varies ♦ Some ? 
a agencies reported that the findings^ research funded were included in gteat 
detail in the final report of ' the, invest igatit^^nd that the agency had i up ( ■ 



^^t^ six months to -publish o 
; principal invest igatotr dbu 



i othertfis^ dissemindte the information before ^h^ 
d publish. In other ^g^ncies i - almost reverse 



' conditions? applied ^ In tb^6> :th^ f ml^hlrnotvincMde^^^^^ - -i 1 

full fepbrts of f indirigsV howevef i {the principal inve^tigatot has six months 
af ter>tyfrhinatiSn^6£ the grants irt which to publish before the agency can make 
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findings available. Again, this reflects a difference in agency philosophy* 
In the first situation, research findings are presumed to be the property 
of the ageifey. In the sedond, research findings are considered the property 
of the investigator; * • . V [ r . 

To some extdnt i this difference i,n agency philosophy "affects the methods 
of disseminating information back to the R & D community. However, there was 
less variation: reported in How findings are disseminated than in any other 
aspect of "the R&D cycled All agencies reported that research findings were 
published in professional journals, at professional conferences, as well as 
in pyblications of a less technical nature and often disseminated through 
other media of the investigator 1 ^ choice. Most agencies which give, prior \. 
publication rights to researchers require that the jnethod for dissemination 
of findings be described in the research proposal • those agencies which 
retain initial publication tights did not report that they ma^e/ this require- 
ment of their researchers. All agencies reported that they^ supplied infbr- 
teatiqn to the Sill information system and nearly all reported that they sent 
final reports to the ERIC system. Both the Mil and the H^IH information . 
systems are used ty some .agencies . ' Three agencies mentioned . that they pub^ 
vlished annotated bibliographies which are Updated regularly. - : ^r" ; 

A variety of other dlssemiriation methods s were mentionkdT * One agency * ; 
b^s^ funded a special dem\>n$trati6n project j:o 3ettd resource people out into ^ "- 
the fi^ld to visit: sery^c-a progratn^^ 
T ^he^inforf^ P<yor other agencies reported that , \ ' 



x 



: r ' they disseminatedx^cw research findings by : planhin^ special conferences in 

;\ ' . $ pki^ t^c, &cea& ar^d^hold ingVthes^ in vaf iotis regions Some agencies 



: ; .W : ^ub lislv thevprccecdinp in forma tiofi md^e ; 



widely available . Two agencies 1 repot t thMt they have a special staff 

devoted .to developing new methods for dissethination of information, and ' 

oth^r agencies reported that they make dissemination grants. 

There is more variation between the agencies in how they utilize - - 
research findings internally than in how th^y &|jp :4dl8aetn3Lfiate externally. 
In three agencies, interim reports ^re summarized by the project officer, 
and the data made available to key staff involved in program planning. 
In another, there is ^a special analysis section of the agency which considers 
research findings and makes recommendations "for "utilization of Research 
findings is less formal and depends upon verbal reports of project officers y 
to key inning staff. Most 'agfencles reported holding iri-house', departmental 
conferences and sometimes inter-agency conferences in particular research 
areas. At these conferences recent findings are reviewed and future plans, 

.-T- \. --v.", <•:••;•' .,.-r. : ..,/•/.• ,•• . v :V- .'). ; • = :':v,:; •: .: V, . ; V-': — 

discussed/ <?Two agencies reported that they had task forces to stud^n^ 
report on the utilization of research for planrtihg, in special are^s. One 



agency has contracted *to have every final report abstracted. In addition 
project officers attempt to fl^g important findings for consideration by pro- 
■ grani and R & P staf f - . ; v . ; y;.^ ; .V:; ; '. ; ; >; - - : v : • 

~Z Though different' agencies reported different methods by which research 
findings are tit ilized within the agency to make further poiicy decisiqnsi all 
reported Worne ^ 



research studies were consider-»<r"by staff in reassessing and refining agency 



0ed~^ x dWeT6p betpet^rt^hods to disseminate ufilifee research findings* 
Spoffeneously * v\$%. than half of (those interviewed mentioned the Yime lag 
between research findings and their Implementation, into future programs* 
Interest was expressed in learning of innovative dissemination methods being 
employed by other agencies « The list of recommendations made of ways v in 
which the Interagency Panel can promote the broader /dissemination of research 

findings is in Appendix 8* v - »' 

i ;>^:;y ;; : •; >;' : ,:.' y v;^ : ;.-. :/•/. v.,.; \V. : - : . : : ; -;'v; 

Summary and Co ncl usions ^ - 

The members ,qf the Interagency Panel on Early Childhood Research and 
Development reported a wide variety of processe^by* which^ research priorities ; 
are. established. Various' internal and extejrMl factors influence thesi 
processes at all stages of the R & D cycle : 5 planning , funding , implementa- 
tion, ^nd disseminatipn. Among these^factors are the official agehcy * 
ob^fectives stemming from it^ legislative mandate,^ th% structure of the agency, 
the major emphasis on research of the agency: basic, applied, evaluative, 
etc. In ad^Ltion, the process' of .establishing priorities iS" 4 alsO influenced 
by the predominant funding ^mechanisms utilized by the agency, the review 
system through which proposals are approved as well as the internal commu~_Lj 



1 



Tilx^i^^syst f or utiliEing research findings in future - program) planning. 
- Though there were wide^ ; differences found in both the extent and the 
processes by which ^gencies established their "p^oriti6s,- it; was found t|\at 
/all agencies do engage' in s6me ptoc^ss^of ^est^biilhi^g: and assessing their 
^ri6titi6$ rat ev^ry ^tdg^ df the R & B cyfcls; Further f all agencl6^ have j 



an established system for repotting and utilizing Research findings in 
refining their priorities ahd making future program plans. All agencies ^ 
also reported, however » that their long and short term research priorities 
were also influenced by factors outside of their control: : directives 
from pttter federal sources as , well as 'changing social neeas and pressures. 
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QUESTIONNAIRE FOR INTERAGENCY PANEfc 

' Selection of Research ^Pr^orlfies 

Note: The procedures of concern here are those pertaining to specification 

of the substance- or content of research and not with routine grant 
t. or project approval or funding procedures. 

1, Does your department or agency* have ''official" objectives regulating 

. research priorities relating to ypung children?. General on-going Or 
short range, specific? For FY '72, FY f 73? T ' 

2. Does your department or agency have official Qr understood research 

* priorities related to .young children? General, 'on-going or short range, 
specific? For FY '72 or FY '73? ; v • ; -V- ; ; 



3^ , What sources of information are available to early childhood research ' ■ 

and development staff about departmental or ^geicy long-range plans 
* and priorities? " - ~ < : ' — ' . / - "■ 

• "'■ '■■-r'^'- ' /..^ ■;/■■;'■; . v: .; ^ 'V v^v •^••••••^•,V V : '.; "• > V >V-V : ; . " • - 

An Is there a formal process? f br establishing agency or Bureau early 
childhood research and development priorities? $hat\analy tic tech- 
niques are used in generating research and development priorities? 

5.* What are the other influences on tHe selection of'research priorities, * 
/ ' if any? " ' ' . ; ' \ ^ -. 

6i What ^re the formal and informal means for coordinating agency objectives 
and eat ly childhood research and development priorities? ' 

; ■.■ .- . , ■:■■'■:}■■','-', 

7 f~~ What are the formal^ and informal means for translating early childhood ; 

' researdh priorities into agency research and development programs and V* 

projects? (rfbw is : research content determined? When does the procedure 

"starts WhererAat what level? Who makes the initial recommendation about 

1 ./where; to put . research money?) 4 - ^ ' > ^ . \ 



8 # ; Doe$ t ne agency fund ongoing prdferaras, which are not neces sati ly 
related to research priorities? v - ; 



9 . \^tt e/ th^ ' sufcs tance of 1 ^r o^rain* and pro jec t s is - de termiMd , what elements 
are con&ide^6cl f tfife 5 13 i ^ t f iKo fe £oh i © f <: £ drtd iri 4? , v ^, v ^ ^ - - v ^ 



* Dissemination of Research Findings • 

. .\ , ...... * ; - r ■• \ - 

10. What means are used in your agency to provide for the u^lization of 4 
rese^Jph' findings in ways to influence planning^processes and policy 
decisions? ; -Vy : : ^N^T^/'* • ^ : 



■ / 



I*. 

z 

*/ ■ 



\ 



■ * 



Agency apparatus and methods"' 
Formal * 

v . - V' Informal '-^ ■ " ' 

Other means— * journal articles '.. 'i< " \ 

,.. ' reports > ; ; '. >> / \ ■ « ■ / ;" ; 

. , ' ' conferences w >J^ ; \ • ' . •'• 

. ' - * - ta^jc forces. ; ' '.• ■ 

;*•;•/•• ^-v-^- •;'•••*; , .v v othbr ' .„ / . X ...;.":,!.:.- ■ '• 

' .' , ■ .. \ >■ ■' : - . . • ; •■ ' •:• ■■■ ' .-. : - • - . t; " : -". \ . ' : - 

11. What information is tnade avai-lable, to researchers ahput early childhood 
research and development prioritieis? 

By' what procedures? ^ \ ■ 

. : ' ! ' " ■ «'•'•.'•'.•.'.'.'•''". | V ' '' r ';'.:- .' r ^ • - " A'-' '. •..'•..'/• • ':. r- " '" .'~'\ • ■' : ,. .: •••/•''). • " •' ^ •. ' . 

''•••• v - .:'.">,:. : ;. : 'v.-'. ' •-.">;.:. y ' - • ••" 

. / 42. What means are used to disseminate information to other government 
ll agepcies, about, on-going grants and projects? 



13. What are y outl-jf ^commend a t i on s for ways the Interagency Panel cary ptdtopt^ * 
the broider dissemination pf research findings and particularly the use/ - x p 
of ^findings in the making of policy decisions? , ^ ; ; / * - 



: : .r ■ 
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Responses to the question: '"What are your^recoirmendatipns for ways ttye 
Interagency Panel can promote the broader dissemination of research ^indings^ 
and particularly, the use of findings in the making of policy decisions?* 

' ■' , .. ' ,•* *' ■ , . 

1 . : Requite each grantee to include a research t utilization Qomponent in 

the ip final application and a policy implications section . 

2. Develop dissemination demonstrations. . ^ 

3. * Support interdepartmental projects on the utilization of knowledge at 

universities. * ? y 

A. Support morp "state of the art" volumes with contributions from many 
researchers at frequent .intervals . * 

5. Provide reports with factual and substantive information (not state of 
the art) on early childhood research. V Include government funded as 
well as Research being funded by universities , . foundations and other 
; private sources . %- ■ ,[ ; • * 

* •." . :** v.. ': 4>;-.' . » ? 1 .'; . * 

6v Distribute documents prepared for the interagency Panel outside of . 
government . • ■* ■'.».. ■■>•"' . ■■'^•■. ■ ^ ■'. •> 

V ' : V- / : ; . . / : J ' ■ .-. • 

7. Send representatives of the; Interagency Panel to professional meetings 
to describe worly of the Panel and provide information on current re- • 
Search. - . / y : ;/.."••■ , ; ' • * 

8. Experiment with presenting significant researth findings in publications 
Vt geared to "pre/gram operators . . ' 

9. Experiment w^th multimedia to disseminate research findings. .. • 

lQv Make more use of the Externshlp approach. \^hen there t i§ a good^demon- 
*'\. ' st rat ion, have key people spend\ a week there^ and other program eeople 
spend ^three months; - J ^ 

11;] Ffeder^l fpnd^ should supp a regional/ basis which focus 

' on utilisation of= knowledge , • Greater technical assistance should be 
. provided tb regional and K>cal levels; V > 

12. Reporting of "research f indiftg^ withltt the federal government should$>e ; 
: itnproved including seeing brief deports to the Secretary highlight iti^ - 
v important findings and practical implications . . / . - ^ N 



./■■■-. 1 * 



13. Research findings might be provided the planning , program, and, 
budget offices within the agency. . >V 

14 1 The Interagency Panel might assume a responsibi] ity fpt providing 
irif oraatiqn to decision makers at a time when decisions lare J,n the 
process of being made . J: i 

■••;".*:•••*': >•:••- ■ v- { ". : . .••••*• * ' •„ • - ' :'\ • '•'.:{■' -V 

15. In addition, more detailed reports /of the same nature ihoulcf be 4 
distributed to operating agencies, Congressional of ^ 

and state offices. J 

16. Disseminate information which casts doubts on previous findings, Or 



amplifies existing findings to forewarn makers of policy that much 
data are too fragile to use in large $cale applied programs. Along 
v with* findings > qualifications should be disseminated to convey that 
it is necessary to recreate the total situation to get the same 
results. ' J ,••"•//• . 

17 ♦ Research findings should not be oversold . They should be dissemi- 
* nated in such a way that policy decisions will become more cautious 
and more competent* V • 

18«° Make the information in the Interagency computer available to metobers 
of the Panel and to others in the field. Provide on line service. 

19. Stbre results from early childhood studies in the Interagency computer 
system. Have immediate On line access available to planning, pro- 
gram and budget offices. , V 




GLOSSARY 



The term agency is used to refer to the individual units 
participating on the Interagency Panel on Early Childhood 
Research and Development . The term includes three "offices 11 
(OASPE , 6t0 and 0E0) . It does not include the Office of 
Education, but does include three bureaus of the Office of 
Education: BEH, BE.SE, BEbP.- Agency is also used to refer c 
to two Centers within NIMHi^ Behavioral Sciences. Research 
Branch and the Center for Studies of Child and Family 
Mental Health, The term also is used in reference to one 
Institute: NIpHD, as well aft to MCHS and to SR&/CSA. 

is used to refer to a subdivision of an agency. 

The smallest unit of funding is\called a project and in- 
eludes a clearly defined projectVor small group of closely 
related research activities. Prefects includes funds for 
conferences, publications, and training programs as well 
as research and demonstration, r * 

Programs refer to funding to larger scale, btoa^-based, 
generally long range research of several projectsx^n an . 
area of special Interest to the funding agency. Examples ' 
of programs^ are Foilow-\ttfrough and Planned Variations. 

Large scale , gener^ lly , lipng term funding of research ins t i-^ 
tutes within, or outside of universities or school systems, 
in which several projects in a particular area, often of an 
interdisciplinary nature, are conducted. Examples of Center 
• funding are the Mental ftetardatlon Centers of ttlCHD and .the 
regional educational laboratories of OE. 

\ . 1 " . , >-.Y . : /.. . 

Proposals submitted to a funding agency in the area of 

nterest of the Principal Investigator , arid not in response 

to a\ notification of interest by an agency. These proposals' 

are Usually submitted without prior knowledge of , or en-* 

couragement by staff* * -\ , V" 'v/V- J; 

: . ' ' - ■ • ■ '•. : ' : ' ". < 5 3 :4=-l-v : * ; - ; : ; V - ' • ; ; ^--v" . "■' • ' . • . ",' ' . . . 1* .V. 

Allocat ion of lump sums . of funds to States , Local units/ | 
School systems, etc i , on the basis of some predetermined V- * 
criteria such as > number bf low income chi ldren, number of 
preschool children, population of tfie county. 



Grants made on proposals obtained after agency priorities 
have been circulated. Contact With prospective investi- 
gators may be made informally, through telephone or . 
personal contact with staff, or publication of research 
priorities in professional journal^. 

Specifications for research are established within the 
agency, an RFP issued, and contract awarded on the. basis, 
of bids ; 



These grants are initiated by staff of the funding 'agertcy 
to meet the special needs of development in areas lacking 
in adequate research activity, and in which the. agency has 
a direct interest. Staff maintain control and supervision 
of research at all stages, and may f actually collaborate 
with the investigators* Special grants are thus very 
similar to contracts, but are usually made to non-profit 
institutions rather than private firms. 



